Multi-camera serial video data conversion for graphics processing unit (gpu) interface

ABSTRACT

Systems, methods, and apparatus for converting serial video data for a graphics processing unit (GPU) interface are disclosed. In one or more embodiments, a disclosed method comprises receiving, by each of a plurality of gigabit multimedia serial link (GMSL) conversion modules, n-bit length serial video data from a plurality of high-resolution cameras respectively. The method further comprises converting, by each of the GMSL conversion modules, the n-bit length serial video data to m-bit length serial GMSL video data, where n is equal to twice m. Also, the method comprises receiving, by a GMSL to camera series interface (CSI) conversion unit, the m-bit length serial GMSL video data from each of the GMSL conversion modules. Further, the method comprises converting, with the GMSL to CSI conversion unit, the m-bit length serial GMSL video data to m-bit length serial CSI video data, which is compatible with the GPU interface.

FIELD

The present disclosure relates to video data conversion. In particular,it relates to multi-camera serial video data conversion for a graphicsprocessing unit (GPU) interface.

BACKGROUND

Currently, cameras capable of directly interfacing with a graphicsprocessing unit's (GPU's) specific data bus are high pixel count, highdata rate cameras. However, these cameras lack sufficient opticalresolution at ranges required by applications for autonomous vehicles.Autonomous vehicle applications, including space-based applications,require the use of long-range cameras (e.g., high definition (HD)cameras) that are able to operate at a high optical resolution. However,these higher caliber cameras are in video formats that are notcommensurate of the data bus of a GPU (e.g., an Nvidia TX1 GPU).

Currently, conventional solutions for interfacing cameras with highoptical resolution with GPUs involve the use of field-programmable gatearrays (FPGAs). In particular, these solutions employ multiple FPGAs toconvert each video stream, and a larger FPGA to encode the data at aless efficient compression method (e.g., H.264/MPEG-4 advanced videocoding (AVC)) than utilized by GPUs (e.g., H.265/high efficiency videocoding (HEVC)). These solutions require multiple FPGA sets for eachcamera's video stream, and are inefficient and costly.

There is therefore a need for an improved technique for interfacingcameras with high optical resolution with GPUs.

SUMMARY

The present disclosure relates to a method, system, and apparatus formulti-camera serial video data conversion for a graphics processing unit(GPU) interface. In one or more embodiments, a method for convertingserial video data for a GPU interface comprises receiving, by each of aplurality of gigabit multimedia serial link (GMSL) conversion modules,n-bit length serial video data from a plurality of high-resolutioncameras respectively. The method further comprises converting, by eachof the GMSL conversion modules, the n-bit length serial video data tom-bit length serial GMSL video data. In one or more embodiments, n isequal to twice m. Also, the method comprises receiving, by a GMSL tocamera series interface (CSI) conversion unit, the m-bit length serialGMSL video data from each of the GMSL conversion modules. Further, themethod comprises converting, with the GMSL to CSI conversion unit, them-bit length serial GMSL video data to m-bit length serial CSI videodata, which is compatible with the GPU interface.

In one or more embodiments, the converting, by each of the GMSLconversion modules, of the n-bit length serial video data to the m-bitlength serial GMSL video data comprises receiving, by a de-serializer ofeach of the GMSL conversion modules, the n-bit length serial video data;de-serializing, with the de-serializer, the n-bit length serial videodata to produce n-bit length parallel video data; converting, with amultiplexer/first-in first-out (MUX/FIFO) of each of the GMSL conversionmodules, the n-bit length parallel video data to m-bit length parallelvideo data; and serializing and converting, with a GMSL serializer ofeach of the GMSL conversion modules, the m-bit length parallel videodata to produce m-bit length serial GMSL video data.

In at least one embodiment, each of the high-resolution cameras is ahigh definition-serial data interface (HD-SDI) camera. In someembodiments, n is equal to 20, and m is equal to 10. In one or moreembodiments, at least one of the high-resolution cameras is mounted to avehicle. In some embodiments, the vehicle is an autonomous vehicle. Inat least one embodiment, the vehicle is an airborne vehicle, a spacevehicle, a terrestrial vehicle, or a marine vehicle.

In one or more embodiments, each of the plurality of GMSL conversionmodules are located proximate the plurality of high-resolution camerasrespectively. In some embodiments, the plurality of GMSL conversionmodules are located proximate the GMSL to CSI conversion unit. In atleast one embodiment, the GMSL to CSI conversion unit is locatedproximate the GPU interface.

In at least one embodiment, a system for converting serial video datafor a GPU interface comprises a plurality of high-resolution cameras.The system further comprises a plurality of GMSL conversion modules toeach receive n-bit length serial video data from the plurality ofhigh-resolution cameras respectively, and to each convert the n-bitlength serial video data to m-bit length serial GMSL video data. In oneor more embodiments, n is equal to twice m. Also, the system comprises aGMSL to CSI conversion unit to receive the m-bit length serial GMSLvideo data from each of the GMSL conversion modules, and to convert them-bit length serial GMSL video data to m-bit length serial CSI videodata, which is compatible with the GPU interface.

In one or more embodiments, each of the GMSL conversion modulescomprises: a de-serializer to receive the n-bit length serial video dataand to de-serialize the n-bit length serial video data to produce n-bitlength parallel video data; a multiplexer/first-in first-out (MUX/FIFO)to convert the n-bit length parallel video data to m-bit length parallelvideo data; and a GMSL serializer to serialize and convert the m-bitlength parallel video data to produce m-bit length serial GMSL videodata.

In at least one embodiment, a system for converting serial video datafor a GPU interface comprises a high-resolution camera. The systemfurther comprises a GMSL conversion module to receive n-bit lengthserial video data from the high-resolution camera, and to convert then-bit length serial video data to m-bit length serial GMSL video data.In one or more embodiments, n is equal to twice m. Also, the systemcomprises a GMSL to CSI conversion unit to receive the m-bit lengthserial GMSL video data from the GMSL conversion module, and to convertthe m-bit length serial GMSL video data to m-bit length serial CSI videodata, which is compatible with the GPU interface.

The features, functions, and advantages can be achieved independently invarious embodiments of the present disclosure or may be combined in yetother embodiments.

DRAWINGS

These and other features, aspects, and advantages of the presentdisclosure will become better understood with regard to the followingdescription, appended claims, and accompanying drawings where:

FIG. 1 is a diagram showing the disclosed system for multi-camera serialvideo data conversion for a graphics processing unit (GPU) interface,where gigabit multimedia serial link (GMSL) conversion modules arelocated proximate the camera serial interface (CSI) module, inaccordance with at least one embodiment of the present disclosure.

FIG. 2 is a diagram showing the details of a GMSL conversion module ofFIGS. 1 and 4, in accordance with at least one embodiment of the presentdisclosure.

FIG. 3 is a diagram showing the details of the operation of themultiplexer/first-in first-out (MUX/FIFO) of FIG. 2, in accordance withat least one embodiment of the present disclosure.

FIG. 4 is a diagram showing the disclosed system for multi-camera serialvideo data conversion for a GPU interface, where the GMSL conversionmodules are located proximate the cameras, in accordance with at leastone embodiment of the present disclosure.

FIG. 5 is a diagram showing an exemplary video decoder system that maybe employed by the disclosed system for multi-camera serial video dataconversion for a GPU interface, in accordance with at least oneembodiment of the present disclosure.

FIG. 6 is a diagram showing an exemplary camera that may be employed bythe disclosed system for multi-camera serial video data conversion for aGPU interface, in accordance with at least one embodiment of the presentdisclosure.

FIG. 7 is a diagram showing exemplary cameras mounted to an exteriorsurface of an exploration upper stage (EUS) rocket, in accordance withat least one embodiment of the present disclosure.

FIG. 8 is a flow chart showing the disclosed method for multi-cameraserial video data conversion for a GPU interface, in accordance with atleast one embodiment of the present disclosure.

DESCRIPTION

The methods and apparatus disclosed herein provide an operative systemfor multi-camera serial video data conversion for a graphics processingunit (GPU) interface. In one or more embodiments, the system of thepresent disclosure provides a solution to convert serial video data fromhigh-resolution cameras (e.g., high definition-serial digital interface(HD-SDI) cameras) into a format compatible with a GPU for high data,multi-camera video processing (e.g., utilizing H.265/high efficiencyvideo coding (HEVC)).

As previously mentioned above, currently, cameras capable of directlyinterfacing with a GPU's specific data bus are high pixel count, highdata rate cameras. However, these cameras lack sufficient opticalresolution at ranges required by applications for autonomous vehicles.Autonomous vehicle applications, including space-based applications,require the use of long-range cameras (e.g., HD-SDI cameras) that areable to operate at a high optical resolution. However, these highercaliber cameras are in video formats that are not commensurate of thedata bus of a GPU (e.g., an Nvidia TX1 GPU).

Conventional solutions for interfacing cameras with high opticalresolution with GPUs involve the use of field-programmable gate arrays(FPGAs). In particular, these solutions employ multiple FPGAs to converteach video stream, and a larger FPGA to encode the data at a lessefficient compression method (e.g., H.264/MPEG-4 advanced video coding(AVC)) than utilized by GPUs (e.g., H.265/high efficiency video coding(HEVC)). These solutions require multiple FPGA sets for each camera'svideo stream, and are inefficient and costly.

The system of the present disclosure provides a more streamlined andless expensive solution for interfacing high-resolution cameras (e.g.,HD-SDI cameras) with a GPU for video processing. In particular, thesystem of the present disclosure provides for the conversion of serialvideo data (e.g., 20-bit length serial video data in HD-SDI protocol)from high-resolution cameras (e.g., HD-SDI cameras) into a GPUcompatible format (e.g., 10-bit length serial video data in cameraseries interface (CSI) protocol) for direct processing by a GPU.

In the following description, numerous details are set forth in order toprovide a more thorough description of the system. It will be apparent,however, to one skilled in the art, that the disclosed system may bepracticed without these specific details. In the other instances, wellknown features have not been described in detail so as not tounnecessarily obscure the system.

Embodiments of the present disclosure may be described herein in termsof functional and/or logical components and various processing steps. Itshould be appreciated that such components may be realized by any numberof hardware, software, and/or firmware components configured to performthe specified functions. For example, an embodiment of the presentdisclosure may employ various integrated circuit components (e.g.,memory elements, digital signal processing elements, logic elements,look-up tables, or the like), which may carry out a variety of functionsunder the control of one or more processors, microprocessors, or othercontrol devices. In addition, those skilled in the art will appreciatethat embodiments of the present disclosure may be practiced inconjunction with other components, and that the system described hereinis merely one example embodiment of the present disclosure.

For the sake of brevity, conventional techniques and components relatedto video data processing systems, and other functional aspects of thesystem (and the individual operating components of the systems) may notbe described in detail herein. Furthermore, the connecting lines shownin the various figures contained herein are intended to representexample functional relationships and/or physical couplings between thevarious elements. It should be noted that many alternative or additionalfunctional relationships or physical connections may be present in anembodiment of the present disclosure.

FIG. 1 is a diagram showing the disclosed system 100 for multi-cameraserial video data conversion for a graphics processing unit (GPU) 150interface, where gigabit multimedia serial link (GMSL) conversionmodules 110 are located proximate the camera serial interface (CSI)module 130, in accordance with at least one embodiment of the presentdisclosure. In this figure, the four (4) GMSL conversion modules 110along with the CSI module 130 are housed within a hardware enclosure160. The CSI module 130 comprises a GMSL to CSI conversion unit (e.g., aQuad GMSL-CSI-2 (Max9286) integrated circuit (IC) chip) 140 and a GPU(e.g., an Nvidia TX1 GPU module) 150 mounted on a carrier card (e.g., adaughterboard). Also in this figure, four (4) HD-SDI cameras 120 are incommunication (via coaxial cables 125) with the four (4) GMSL conversionmodules 110, respectively.

It should be noted that the HD-SDI cameras 120 may be located at adistance away from the hardware enclosure 160. In one or moreembodiments, the HD-SDI cameras 120 are mounted onto a vehicle (e.g.,refer to 700 of FIG. 7). For these embodiments, the hardware enclosure160 may be located far away from the HD-SDI cameras 120. In one or moreembodiments, the vehicle may be an autonomous vehicle or anon-autonomous vehicle. In some embodiments, the vehicle may be anairborne vehicle (e.g., a drone, an unmanned aerial vehicle (UAV), or anaircraft), a space vehicle (e.g., a rocket or satellite) a terrestrialvehicle (e.g., an unmanned ground vehicle (UGV), an automobile, or atank), or a marine vehicle (e.g., an unmanned surface vehicle (USV), aship, or a boat).

In addition, it should be noted that in other embodiments, the disclosedsystem 100 may employ more or less than four HD-SDI cameras 120 than asshown in FIG. 1. In addition, the disclosed system 100 may employ moreor less than four GMSL conversion modules 110 than as shown in FIG. 1.

During operation of the system 100, the HD-SDI cameras 120 record video,and transmit the corresponding video data to the GMSL conversion modules110 via coaxial cables 125. The video data is 20-bit length serialHD-SDI video data (i.e. 20-bit length sequences for each pixel in seriesin HD-SDI protocol). The GMSL conversion modules 110 convert the videodata from 20-bit length serial HD-SDI video data into 10-bit lengthserial GMSL video data (i.e. 10-bit length sequences in series in GMSLprotocol).

Then, the GMSL conversion modules 110 transmit the 10-bit length serialGMSL video data to the GMSL to CSI conversion unit 140 via wires 115.The GMSL to CSI conversion unit 140 converts the 10-bit length serialGMSL video data to 10-bit length serial CSI video data (i.e. 10-bitlength sequences in series in CSI protocol), which is compatible withthe interface of the GPU 150. The GMSL to CSI conversion unit 140transmits the 10-bit length serial CSI video data to the GPU 150 via awire or trace 145. After receiving the 10-bit length serial CSI videodata, the GPU 150 processes the 10-bit length serial CSI video datautilizing an efficient compression method (e.g., H.265/high efficiencyvideo coding (HEVC)).

FIG. 2 is a diagram showing the details of a GMSL conversion module 110of FIGS. 1 and 4, in accordance with at least one embodiment of thepresent disclosure. In this figure, the GMSL conversion module 110comprises a de-serializer (e.g., a LMH-0031 HD-SDI de-serializer ICchip) 220, a multiplexer/first-in first-out (MUX/FIFO) (e.g., a 20-bitto 10-bit MUX/FIFO IC chip) 210, and a GMSL serializer (e.g., a GMSLserializer Max96705 IC chip) 230 mounted on a carrier card (e.g., adaughterboard).

During operation of the GMSL conversion module 110, the de-serializer220 of the GMSL conversion module 110 receives the 20-bit length serialHD-SDI video data from the HD-SDI cameras 120 via a coaxial cable 125(refer to FIG. 1) or a wire 425 (refer to FIG. 4). The de-serializer 220de-serializes the 20-bit length serial HD-SDI video data to produce20-bit length parallel HD-SDI video data (i.e. 20-bit length sequencesin parallel in HD-SDI protocol). Then, the de-serializer 220 transmitsthe 20-bit length parallel HD-SDI video data to the MUX/FIFO 210 via awire or trace 225. The MUX/FIFO converts the 20-bit length parallelHD-SDI video data into 10-bit length parallel HD-SDI video data (i.e.10-bit length sequences in parallel in HD-SDI protocol). Then, theMUX/FIFO transmits the 10-bit length parallel HD-SDI video data to theGMSL serializer 230 via a wire or trace 235. The GMSL serializer 230serializes and converts the 10-bit length parallel HD-SDI video datainto 10-bit length serial GMSL video data (i.e. 10-bit length sequencesin series in GMSL protocol). The GMSL serializer 230 then outputs the10-bit length serial GMSL video data via a wire 115 (refer to FIG. 1) ora coaxial cable 415 (refer to FIG. 4).

FIG. 3 is a diagram showing the details of the operation of themultiplexer/first-in first-out (MUX/FIFO) 210 of FIG. 2, in accordancewith at least one embodiment of the present disclosure. In this figure,an exemplary 20-bit sequence 300 that is generated by a HD-SDI camerafor each pixel of video data is shown. The first ten bits (i.e. D0 toD9) of the 20-bit sequence 300 comprise data relating to the color(e.g., HD chroma, standard definition (SD) luma, and chroma) of thepixel. And, the second ten bits (i.e. D10 to D19) of the 20-bit sequence300 comprise data relating to the intensity (e.g., HD luma) of thepixel.

During operation of the MUX/FIFO 210, after the MUX/FIFO 210 receivesthe 20-bit length parallel HD-SDI video data from the de-serializer 220(refer to FIG. 2), the MUX/FIFO 210 converts the 20-bit length parallelHD-SDI video data into 10-bit length parallel HD-SDI video data via ashift register, which is driven off a video clock (not shown), of theMUX/FIFO 210. The shift register shifts the first 10 bits (i.e. D0 toD9) from the 20-bit length sequence 310 onto a first row during a firstcycle 320 of the video clock, and shifts the second 10 bits (i.e. D10 toD19) from the 20-bit length sequence 310 onto a second row during asecond cycle 330 of the video clock.

FIG. 4 is a diagram showing the disclosed system 400 for multi-cameraserial video data conversion for a GPU 150 interface, where the GMSLconversion modules 110 are located proximate the cameras (e.g. HD-SDIcameras) 120 in accordance with at least one embodiment of the presentdisclosure. In this figure, the four (4) GMSL conversion modules 110 arelocated proximate the HD-SDI cameras 120 such that each of the GMSLconversion modules 110 is housed within the housing 600 (refer to FIG.6) of their respective HD-SDI camera 120, such that each of the GMSLconversion modules 110 are mounted close to (e.g., less than one footaway) their respective HD-SDI camera 120, or such that all of the GMSLconversion modules 110 are mounted together within a hardware housing420 that is mounted close to (e.g., less than one foot away) at leastone of the HD-SDI cameras 120.

The CSI module 130 comprises a GMSL to CSI conversion unit (e.g., a QuadGMSL-CSI-2 (Max9286) integrated circuit (IC) chip) 140 and a GPU (e.g.,an Nvidia TX1 GPU module) 150 mounted on a carrier card (e.g., adaughterboard), which is enclosed in a hardware enclosure 460. Also inthis figure, the four (4) HD-SDI cameras 120 are in communication withthe four (4) GMSL conversion modules 110, respectively. It should benoted that in other embodiments, the disclosed system 400 may employmore or less than four HD-SDI cameras 120 than as shown in FIG. 4. Inaddition, the disclosed system 400 may employ more or less than fourGMSL conversion modules 110 than as shown in FIG. 4.

It should be noted that the HD-SDI cameras 120 and GMSL conversionmodules 110 may be located at a distance away from the hardwareenclosure 460. In one or more embodiments, the HD-SDI cameras 120 aremounted onto a vehicle (e.g., refer to 700 of FIG. 7). For theseembodiments, the hardware enclosure 460 may be located far away from theHD-SDI cameras 120 and GMSL conversion modules 110. In one or moreembodiments, the vehicle may be an autonomous vehicle or anon-autonomous vehicle. In some embodiments, the vehicle may be anairborne vehicle (e.g., a drone, an unmanned aerial vehicle (UAV), or anaircraft), a space vehicle (e.g., a rocket or satellite) a terrestrialvehicle (e.g., an unmanned ground vehicle (UGV), an automobile, or atank), or a marine vehicle (e.g., an unmanned surface vehicle (USV), aship, or a boat).

During operation of the system 400, the HD-SDI cameras 120 record video,and transmit the corresponding video data to the GMSL conversion modules110 via wires 425. The video data is 20-bit length serial HD-SDI videodata (i.e. 20-bit length sequences for each pixel in series in HD-SDIprotocol). The GMSL conversion modules 110 convert the video data from20-bit length serial HD-SDI video data into 10-bit length serial GMSLvideo data (i.e. 10-bit length sequences in series in GMSL protocol).

Then, the GMSL conversion modules 110 transmit the 10-bit length serialGMSL video data to the GMSL to CSI conversion unit 140 via coaxialcables 415. The GMSL to CSI conversion unit 140 converts the 10-bitlength serial GMSL video data to 10-bit length serial CSI video data(i.e. 10-bit length sequences in series in CSI protocol), which iscompatible with the interface of the GPU 150. The GMSL to CSI conversionunit 140 transmits the 10-bit length serial CSI video data to the GPU150 via a wire or trace 145. After receiving the 10-bit length serialCSI video data, the GPU 150 processes the 10-bit length serial CSI videodata utilizing an efficient compression method (e.g., H.265/highefficiency video coding (HEVC)).

FIG. 5 is a diagram showing an exemplary video decoder system 500 thatmay be employed by the disclosed system 100, 400 for multi-camera serialvideo data conversion for a GPU 150 interface, in accordance with atleast one embodiment of the present disclosure. For embodiments wherethe HD-SDI cameras 120 are mounted onto a vehicle (e.g., refer to 700 ofFIG. 7), after the serial video data (e.g., 20-bit length serial videodata in HD-SDI protocol) from the HD-SDI cameras 120 is converted into aGPU compatible format (e.g., 10-bit length serial video data in CSIprotocol) for direct processing by a GPU 150, the GPU 150 processes the10-bit length serial CSI video data to produce a moving pictures expertsgroup (MPEG) data stream. The MPEG data stream is transmitted from anantenna (not shown) on the vehicle to an antenna 510 associated with aground station comprising the video decoder system 500. The videodecoder system 500 receives and processes the MPEG data stream.

During operation of the video decoder system 500, after the antenna 510receives the MPEG data stream, the MPEG data stream passes through aswitch 520 and network interface (NIC) controller card 530, which arepart of the ground station equipment 540, to a processing module 550.The processing module 550 comprises an internet protocol physical layer(IP PHY) IC chip 560 and a GPU (e.g., an Nvidia TX1 GPU module) 150mounted on a carrier card (e.g., a daughterboard).

After the processing module 550 receives the MPEG data stream, the IPPHY IC chip 560 parses the MPEG data stream into four different datastreams, which are transmitted to the GPU 150 via a wire or trace 565.The GPU 150 processes the four different data streams and transmits thevideo data to four displays 590 via an HDMI cable 580 to display thevideo, which was captured by the four HD-SDI cameras 120 (refer to FIGS.1 and 4).

FIG. 6 is a diagram showing an exemplary camera 120 that may be employedby the disclosed system for multi-camera serial video data conversionfor a GPU 150 interface, in accordance with at least one embodiment ofthe present disclosure. In this figure, the camera 120 is shown tocomprise a lens 610 and a housing 600. It should be noted that in otherembodiments, the housing 600 of the camera 120 may be of a differentshape than as depicted in FIG. 6. As previously mentioned above, in someembodiments, the GMSL conversion module 110 (refer to FIG. 4) of thedisclosed system 400 (refer to FIG. 4) may be housed within the housing600 of the camera 120.

FIG. 7 is a diagram showing exemplary cameras 120 mounted to an exteriorsurface of an exploration upper stage (EUS) rocket 700, in accordancewith at least one embodiment of the present disclosure. In this figure,cameras 120 are shown to be mounted on the surface of the exterior of aEUS rocket 700 (e.g., from the space launch system (SLS)). It should benoted that in other embodiments, the cameras 120 may be mounted ontodifferent locations of the EUS rocket 700 than is shown in FIG. 7. Inaddition, it should be noted that more or less cameras 120 may bemounted onto the EUS rocket 700 than as depicted in FIG. 7.

FIG. 8 is a flow chart showing the disclosed method 800 for multi-cameraserial video data conversion for a GPU interface, in accordance with atleast one embodiment of the present disclosure. At the start 810 of themethod 800, each of a plurality of GMSL conversion modules receivesn-bit length serial video data from a plurality of high-resolutioncameras respectively 820. Then, each of the plurality of GMSL conversionmodules converts the n-bit length serial video data to m-bit lengthserial GMSL video data, where n is equal to twice m 830. A GMSL to CSIconversion unit then receives the m-bit length serial GMSL video datafrom each of the GMSL conversion modules 840. Then, the GMSL to CSIconversion unit converts the m-bit length serial GMSL video data tom-bit length serial CSI video data, which is compatible with the GPUinterface 850. Then, the method 800 ends 860.

Although particular embodiments have been shown and described, it shouldbe understood that the above discussion is not intended to limit thescope of these embodiments. While embodiments and variations of the manyaspects of the invention have been disclosed and described herein, suchdisclosure is provided for purposes of explanation and illustrationonly. Thus, various changes and modifications may be made withoutdeparting from the scope of the claims.

Where methods described above indicate certain events occurring incertain order, those of ordinary skill in the art having the benefit ofthis disclosure would recognize that the ordering may be modified andthat such modifications are in accordance with the variations of thepresent disclosure. Additionally, parts of methods may be performedconcurrently in a parallel process when possible, as well as performedsequentially. In addition, more parts or less part of the methods may beperformed.

Accordingly, embodiments are intended to exemplify alternatives,modifications, and equivalents that may fall within the scope of theclaims.

Although certain illustrative embodiments and methods have beendisclosed herein, it can be apparent from the foregoing disclosure tothose skilled in the art that variations and modifications of suchembodiments and methods can be made without departing from the truespirit and scope of the art disclosed. Many other examples of the artdisclosed exist, each differing from others in matters of detail only.Accordingly, it is intended that the art disclosed shall be limited onlyto the extent required by the appended claims and the rules andprinciples of applicable law.

1. A method for converting serial video data for a graphics processingunit (GPU) interface, the method comprising: receiving, by each of aplurality of gigabit multimedia serial link (GMSL) conversion modules,n-bit length serial video data from a plurality of high-resolutioncameras respectively; converting, by each of the GMSL conversionmodules, the n-bit length serial video data to m-bit length serial GMSLvideo data, wherein n is equal to twice m, and wherein the m-bit lengthserial GMSL video data is related to one of a color or an intensity of apixel; receiving, by a GMSL to camera series interface (CSI) conversionunit, the m-bit length serial GMSL video data from each of the GMSLconversion modules; and converting, with the GMSL to CSI conversionunit, the m-bit length serial GMSL video data to m-bit length serial CSIvideo data, which is compatible with the GPU interface.
 2. The method ofclaim 1, wherein the converting, by each of the GMSL conversion modules,of the n-bit length serial video data to the m-bit length serial GMSLvideo data comprises: receiving, by a de-serializer of each of the GMSLconversion modules, the n-bit length serial video data; de-serializing,with the de-serializer, the n-bit length serial video data to producen-bit length parallel video data; converting, with amultiplexer/first-in first-out (MUX/FIFO) of each of the GMSL conversionmodules, the n-bit length parallel video data to m-bit length parallelvideo data; and serializing and converting, with a GMSL serializer ofeach of the GMSL conversion modules, the m-bit length parallel videodata to produce m-bit length serial GMSL video data.
 3. The method ofclaim 1, wherein each of the high-resolution cameras is a highdefinition-serial data interface (HD-SDI) camera.
 4. The method of claim1, wherein n is equal to 20, and m is equal to
 10. 5. The method ofclaim 1, wherein at least one of the high-resolution cameras is mountedto a vehicle.
 6. The method of claim 5, wherein the vehicle is anautonomous vehicle.
 7. The method of claim 5, wherein the vehicle is oneof an airborne vehicle, a space vehicle, a terrestrial vehicle, or amarine vehicle.
 8. The method of claim 1, wherein each of the pluralityof GMSL conversion modules are located proximate the plurality ofhigh-resolution cameras respectively.
 9. The method of claim 1, whereinthe plurality of GMSL conversion modules are located proximate the GMSLto CSI conversion unit.
 10. The method of claim 1, wherein the GMSL toCSI conversion unit is located proximate the GPU interface.
 11. A systemfor converting serial video data for a graphics processing unit (GPU)interface, the system comprising: a plurality of high-resolutioncameras; a plurality of gigabit multimedia serial link (GMSL) conversionmodules to each receive n-bit length serial video data from theplurality of high-resolution cameras respectively, and to each convertthe n-bit length serial video data to m-bit length serial GMSL videodata, wherein n is equal to twice m, and wherein the m-bit length serialGMSL video data is related to one of a color or an intensity of a pixel;and a GMSL to camera series interface (CSI) conversion unit to receivethe m-bit length serial GMSL video data from each of the GMSL conversionmodules, and to convert the bit length serial GMSL video data to m-bitlength serial CSI video data, which is compatible with the GPUinterface.
 12. The system of claim 11, wherein each of the GMSLconversion modules comprises: a de-serializer to receive the n-bitlength serial video data and to de-serialize the n-bit length serialvideo data to produce n-bit length parallel video data; amultiplexer/first-in first-out (MUX/FIFO) to convert the n-bit lengthparallel video data to m-bit length parallel video data; and a GMSLserializer to serialize and convert the m-bit length parallel video datato produce m-bit length serial GMSL video data.
 13. The system of claim11, wherein each of the high-resolution cameras is a highdefinition-serial data interface (HD-SDI) camera.
 14. The system ofclaim 11, wherein n is equal to 20, and m is equal to
 10. 15. The systemof claim 11, wherein at least one of the high-resolution cameras ismounted to a vehicle.
 16. The system of claim 15, wherein the vehicle isan autonomous vehicle.
 17. The system of claim 15, wherein the vehicleis one of an airborne vehicle, a space vehicle, a terrestrial vehicle,or a marine vehicle.
 18. The system of claim 11, wherein each of theplurality of GMSL conversion modules are located proximate the pluralityof high-resolution cameras respectively.
 19. The system of claim 11,wherein the plurality of GMSL conversion modules are located proximatethe GMSL to CSI conversion unit.
 20. A system for converting serialvideo data for a graphics processing unit (GPU) interface, the systemcomprising: a high-resolution camera; a gigabit multimedia serial link(GMSL) conversion module to receive n-bit length serial video data fromthe high-resolution camera, and to convert the n-bit length serial videodata to m-bit length serial GMSL video data, wherein n is equal to twicem, and wherein the m-bit length serial GMSL video data is related to oneof a color or an intensity of a pixel; and a GMSL to camera seriesinterface (CSI) conversion unit to receive the m-bit length serial GMSLvideo data from the GMSL conversion module, and to convert the m-bitlength serial GMSL video data to m-bit length serial CSI video data,which is compatible with the GPU interface.